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(54) Abstract Tltie 

Interface for bank of disk drives 



(57) A data storage system wherein a host computer is in connmunication with a bank of disk drives through 
an interface. The interface includes: a nnemory; a plurality of directors for controlling data transfer between the 
host computer and the bank of disk drives as such data passes through the memory; and a plurality of busses 
in comnnunlcation with the directors and the memory. Each one of the directors includes a central processing 
unit. The central processing unit includes: (A) a microprocessor 46; (6) a main memory 48; and (C) a 
microprocessor interface 52. The microprocessor interface includes: (i) a data rebuffering section 56 disposed 
in the chip and adapted to couple data from a one of a plurality of data ports to a data port of the 
microprocessor selectively in accordance with a control signal; and (ii) a main memory interface 54 adapted 
for coupling to a main memory for the microprocessor, such main memory interface being adapted for 
coupling to the microprocessor and being coupled to the data rebuffering section for providing control signals 
to the main memory section for enabling data transfer between the main memory and the microprocessor 
through the data rebuffering section. A controller is coupled to the data rebuffering section for producing the 
control signal. The central processing unit main memory is a selected one of a plurality of memory types each 
type having a different data transfer protocol and the main memory interface is configured in accordance with 
the selected one of the plurality of memory types to provide a proper memory protocol to data being 
transferred between the microprocessor and the main memory through the main memory interface. One main 
memory is an SDRAM and another a RDRAM. 
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DATA STORAGE SYSTEM 
Background of the Invention 
5 This invention relates generally to data storage systems, and more 

particularly to data storage systems having redundancy arrangements to protect 
against total system failure in the event of a failure in a component or subassembly of 
the storage system. 

As is known in the art, large mainframe computer systems require large 
10 capacity data storage systems. These large main frame computer systems generally 
include data processors which perform many operations on data introduced to the 
computer system tfirough peripherals including the data storage system. The results 
of tfiese operations are output to peripherals, including the storage system. 

One type of data storage system is a magnetic disk storage system. Here a 
1 5 bank of disk drives and the main frame computer system are coupled together through 
an interface. The interface includes CPU, or "front end", controllers (or directors) and 
"back end" disk controllers (or directors). The interface operates die controllers (or 
directors) in such a way that they are transparent to the computer. That is, data is 
stored in, and retrieved from, the bank of disk drives in such a way that the mainframe 
20 computer system merely thinks it is operating with one mainframe memory. One 
such system is described in U.S. Patent 5,206,939, entitled "System and Method for 
Disk Mapping and Data Retrieval", inventors Moshe Yanai, Natan Vishlitzky, Bruno 
Alterescu and Daniel Castel, issued April 27, 1993, and assigned to the same assignee 
as the present invention. 
25 As described in such U.S. Patent, the interface may also include, in 

addition to the CPU controllers (or directors) and disk controllers (or directors), 
addressable cache memories. The cache memory is a semiconductor memory and is 
provided to rapidly store data from the main frame computer system before storage in 
the disk drives, and, on the other hand, store data from the disk drives prior to being 
30 sent to the main frame computer. The cache memory being a semiconductor memory, 
as distinguished from a magnetic memory as in the case of the disk drives, is much 
faster than the disk drives in reading and writing data. 

The CPU controllers, disk controllers and cache memory are 
interconnected through a backplane printed circuit board. More particularly, disk 
35 controllers are mounted on disk controller printed circuit boards. CPU controllers are 
mounted on CPU controller printed circuit boards. And, cache memories are mounted 



on cache memoiy printed circuit boards. TTie disk controller, CPU controller and 
cache memoiy printed circuit boards plug into the baclcplane printed circuit board In 
order to provide data integrity in case of a failure in a controller, the backplane printed 
circuit board has a pair of buses. One set the disk controllers is connected to one bus 
5 and another set of the disk controllers is connected to the other bus. Likewise, one set 
the CPU controllers is connected to one bus and another set of the CPU controllers is 
connected to the other bus. The cache memories are connected to both buses. Each 
one of the buses provides data, address and control information. 

Summary nf thp Inv^tir^ 
1 0 In accordance with the present invention, a data storage system is provided 

wherem a host computer is in communication with a bank of disk drives through an 
mterface. The interface includes: a memory; a plurality of directors for controlling 
data transfer between the host computer and the bank of disk drives as such data 
passes through the memory; and a plurality of busses in communication with the 
15 duectors and the memory. Each one of the directors includes a central processing unit 
The central processing unit includes: (A) a microprocessor; (B) a main memory; and 
(C) a microprocessor interface. The microprocessor interface includes a 
semiconductor integrated circuit having fomied therein: (i) a data rebuffering section 
disposed in the chip and adapted to couple data from a one of a plurality of data ports 
20 to a data port of the microprocessor selectively in accordance with a control signal- 
and (II) a main memory interface adapted for coupling to a main memory for the ' 
microprocessor, such main memory interface being adapted for coupling to the 
microprocessor and being coupled to the data rebuffering section for providing 
control signals to the main memory section for enabling data transfer between the 
25 mam memory and the microprocessor through the data rebuffering section A 

controller is coupled to the data rebuffering section for producing the control signal. 

In one embodiment of the invention, the central processing unit main 
memory is a selected one of a plurality of memo^^ types each type having a different 
data transfer protocol and the main memory interface is configured in accordance with 
30 the selected one of the plurality of memory types to provide a proper memory 

protocol to data being transferred between the microprocessor and the main memory 
through the main memory interface. 

In accordance with one embodiment of the invention, one main memory 
type IS an SDRAM and in another type is a RDRAM. 



In accordance with another feature of the invention, the central processing 
unit data rebufFering section includes: a selector responsive to the control signal for 
coupled data between a selected one of the data ports and the microprocessor. 

In one embodiment, the data rebuffering section includes a data 
5 distribution unit having a plurality of ports each one of the ports being coupled to a 
corresponding one of: (i) the selector; (ii) a random access memory; (ili) an interrupt 
request controller; (iv) the microprocessor data port; and (v) the main memory 
interface. 

In accordance with another feature of the invention, a data storage system 
10 is provided wherein a host computer is in communication with a bank of disk drives 
through an interface. The interface includes: a memory; a plurality of directors 
for controlling data transfer between the host computer and the bank of disk drives as 
such data passes through the memoiy; and a plurality of busses in communication 
with the directors and the memory. Each one of the directors includes a central 
15 processing unit. The central processing unit includes: (A) a microprocessor; (B) a 
main memory having a plurality of data storage sections, one section having a first set 
of addresses and a second section having addresses a second set of addresses; (C) a 
microprocessor interface. The interface includes: (i) a memory controller for 
producing addresses for the main memory, such memory controller having a decoder 
20 responsive to the produced addressed to determine whether the produced address is 
within the first set or the second set of addresses; and (ii) a main memory interfece 
adapted for coupling to a main memory for the microprocessor, such main memory 
interface being adapted for coupling to the microprocessor and being coupled to the 
data rebuffering section for providing control signals to the main memory section for 
25 enabling data transfer between the main memory and the microprocessor through the 
data rebuffering section. A controller is responsive to the decoder, for enabling the 
second section in the memory when the decoder determines the produced address is in 
the second set of addresses. TTie first section is enabled for addressing by the 
produced address when the decoder determines the produced address is in the first set 
30 of addresses. 

In one embodiment, the system includes a mask to transform the address to 
an address in the second section of the memory. 



35 
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Brief Description of the Drawing s 
These and other features of the invention wiJl become more readily 
apparent fiom the following detailed description when read together with the 
accompanying drawings, in which: 

5 FIG. 1 is a block diagram of a data storage system according to the 

invention; 

FIG. 2 is a block diagram of an exemplary one of a plurality of directors 
used in die system of FIG. 1, such director having a central processing unit in 
accordance with the invention; 

10 FIG. 3 is a block diagram of a microprocessor interface used in the central 

processing unit of the director of FIG. 2; 

FIGS. 3A through 3C are block diagrams of an XCVR core and a CPU 

XCVR used in the microprocessor interface of FIG. 3. FIG. 3A showing the data 

rebuffering mechanism which supports microprocessor read operations, FIG. 3B 
1 5 showing the data rebuffering mechanism that supports microprocessor read 

operations, and FIG. 3C showing data rebuffering mechanism that supports the 

microprocessor address path; 

FIG. 3D is a diagram useful in understanding an addressing feature 

provided by the microprocessor interface of FIG. 2 In accordance with the invention; 

20 4 is a block diagram ofa main memory interfece according to the 

invention used in the microprocessor interface of FIG. 3; 

FIG. 5 is a block diagram of an error detector and corrector according to 
the invention used in the main memory interface of FIG. 4; 

FIG. 5A is a block diagram of an XOR arrangement used in the error 
25 detector and corrector of FIG. 5 ; 

FIG. 6 is a block diagram of an interrupt request controller used in the 
microprocessor interface of FIG. 3; 

FIG. 7 is a block diagram of an interrupt inverter register used in the 
interrupt controller of FIG. 6; 

30 FIG. 8 is a block diagram of an interrupt type register used in the interrupt 

request controller of FIG. 6; and 

FIG. 9 is a diagram of a fault detector adapted to detect hard faults on a bi- 
directional data line according to the invention. 

35 
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Description of the Preferred Embodiments 
DATA STORAGE SYSTEM 
Referring now to FIG. 1, a data storage system 10 is shown wherein a host 
computer 12 is coupled to a bank 14 of disk drives through a system interface 16. The 
5 system interface 16 includes a cache memory 18. A plurality of directors 20o-20i5 is 
provided for controlling data transfer between the host computer 12 and the bank 14 
of disk drives as such data passes through the cache memory 1 8. A pair of high 
address busses TH, BH is electrically connected to the high address memory section 
18H of cache memory 18 as described in U. S. Patent application Serial No. 
1 0 09/223, 1 1 5 entitled "Data Storage System", inventors D. Castel et al, filed December 
30, 1998, assigned to the same assignee as the present invention, the entire subject 
matter thereof being incorporated into this application by reference. A pair of low 
address busses TL, BL is electrically connected to the low address memory section 
18L of cache memory 18. The cache memory 18 has a plurality of storage location 
15 addresses. Here, the storage locations having the higher addresses are in the high 
address memory sections 18H and the storage locations having the lower addresses 
are in the low address memory sections 1 8L. It should be noted that each one of the 
directors 20o-20i5 is electrically connected to one of the pair of high address busses 
TH, BH and one of the pair of low address busses TL, BL. Thus, each one of the 
20 directors 20o-20i5 is able to address all locations in the entire cache memoiy 18 (i.e., 
to both the high address memory sections 18H and the low address memory sections 
1 8L) and is therefore able to store data in and retrieve data from any storage location 
in the entire cache memory 18. 

More particularly, a rear-end portion of the directors, here directors 20o- 
25 2O7, is electrically connected to the bank 14 of disk drives and a front-end portion of 
the directors, here directors 208-20i5, is electrically connected to the host computer 
12. _ 

In operation, when the host computer 12 wishes to store data, the host 
computer 12 issues a write request to one of the front-end directors 208-20i5 to 
30 perform a write command. One of the front-end directors 208-20i5 replies to the 

request and asks the host computer 12 for the data. After the request has passed to the 
requesting one of the front-end directors 208-20i5, the director determines the size of 
the data and reserves space in the cache memory 1 8 to store the request. The front- 
end director then produces control signals on either a high address memory bus (TH 
35 or BH) or a low address memory bus (TL, BL) connected to such front-end director 
depending on the location in the cache memory 18 allocated to store die data and 
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enables the transfer to the cache memory 18. The host computer 12 then transfers the 
data to the front^nd director. The front^nd director then advises the host computer 
12 that the transfer is complete. The fiont^jnd director looks up in a Table, not 
shown, stored in the cache memoiy 1 8 to determine which one of the rear-end 
5 directors 2O0-2O7 is to handle this request. The Table maps the host computer 12 
address into an address in the bank 14 of disk drives. TTie front^nd director then puts 
a notification in a "mail box" (not shown and stored in the cache memoiy 18) for the 
rear-end director which is to handle the request, the amount of the data and the disk 
address for the data. Other rear-end director poll the cache memory 1 8 when they 
10 are idle to check their "mail boxes". If the polled "mail box" indicates a transfer is to 
be made, the rear-end director processes the request, addresses the disk drive in the 
bank, reads the data from the cache memory and writes it into the addresses of a disk 
dnve m the bank 1 4. When data is to be read from the disk drive to the host computer 
12 the system operates in a reciprocal manner. 

DIRECTOR 

Referring now to FIG. 2, an exemplary one of the directors, here director 
2O0. is shown. The director 20o has an X CPU section 22 and a Y CPU section 24 
which share shared resources 40 such as flash memories, etc. The flash memoiy 
stores the BIOS, or boot-up routine, for the CPU sections 22, 24. The X and Y CPU 
20 sections 22, 24 are identical in construction, the X CPU section 22 being shown in 
more detail in FIG. 2. Here, the X CPU section 22 shown is a rear end director and 
thus IS coupled to the disk drives 14 (FIG. 1), it being understood that had such 
section been in a front end director such X CPU section 22 would have been 
connected to the host computer 12. TTie X CPU section 22 is also coupled to the 
25 cache memoiy 1 8 (FIG. l), as indicated. 

Referring in more detail to the X CPU section 22, it is noted that such 
section 22 includes a Direct Memory Access (DMA) section 42 which is an interface 
between the cache memory I8(FIG. 1). the bank of disk drives 14 and the central 
pixxessing unit 44 of the X CPU section 22. TTie central processing unit 44 includes a 
30 microprocessor 46, here a Power PC microprocessor, a main memory 48, a CPU 
decoder 50 (e.g., a programmable logic device), and a microprocessor interface 52 
here an Application Specific Integrated Circuit (ASIC). ITie microprocessor interface 
52 Will be described in more detail in connection with FIG. 3. Suffice it to say here, 
however, that the microprocessor interface 52 is a comprehensive Power PC 
35 microprocessor support integrated circuit chip having several discrete functional 
sections, including a main memoiy interface 54 having a set of registers 53. a data 
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rebuffering section 56, an interrupt request (IRQ) controller 58, and an embedded 
Static Random Access Memory (SRAM) 60. Here, the main memory 48 is an 
SDRAM, however, as will be described, other types of memories may be used such as 
a RAMBUS DRAM (RDRAM). 
5 Here, the main memory interface 54 is adapted to manage one or two 

banks of main memory 48 SDRAMs, providing up to 128 MB of memory I/O space 
using 64-megabit RAM densities. The data is Error Correction Code (ECC)-protected 
and single-bit errors can be corrected as they are detected. The main memory 
SDRAM interface 54 fully supports byte, half-word and word reads and writes 
1 0 through built in Read-Modify- Write cycles. 

The interrupt request (IRQ) controller 58 provides flexible interrupt 
management. Here, the interrupt request controller 58 supports up to 28 external 
interrupts and 4 fatal interrupts as well as internal interrupts. These interrupts can be 
assigned to any interrupt level by programming level and mask registers which will be 
15 described in more detail in connection with FIG. 6. In addition, the interrupt request 
controller provides facilities to assist in Motorola 68060-style interrupt generation as 
will also be described in more detail in connection with FIG. 6. 

The data rebuffering section 56 of the microprocessor interface 52 
provides dual-bus address and data rebuffering. Fully flexible and controlled by the 
20 external CPU decoder 50, the address and data paths are rebuflfered to enable 
connection to local and shared resources 58. The options of registering data, 
assembly/disassembly function, and pari^ generation are controlled by the logic in 
the external CPU decoder 50. 

The microprocessor interface 52 also provides facilities to capture address 
25 and data ranges, and to provide interrupts upon capture. This capability is useful for 
debugging operations to trap rouge address or data cycles. 

CENTRAL PROCESSING UNIT 44^ 
Referring now also to FIGS. 2 and 3, the central processing unit 44 (FIG. 
2) of the du-ector 20o includes, as noted above, a microprocessor 46; a main memory 
30 48; a CPU decoder 50; and a microprocessor interface 52, here an ASIC. The data 
rebuffering section 56 of the microprocessor interfece 52 is adapted to couple data 
from a one of a plurality of data ports, here data port A, data port B, and data from the 
embedded SRAM 60 and interrupt request controller 58, to a data port of the 
microprocessor 46 selectively in accordance with a control signal supplied by the 
35 CPU decoder 50. The main memory interface 54 is adapted for providing control 
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signals to the main memory 48 section for enabling data transfer between the main 
memory 48 and the microprocessor 50 through the data rebuflfering section 56. 

As noted above, die main memory 48 is a selected one of a plurality of 
memory types, such as an SDRAM or an RDRAM. Each memory type has a different 
5 data transfer protocol. The main memory interface 54 is configured in acconiance 
with the selected one of the plurality of memory types to provide a proper memoiy 
protocol to data being transferred between the microprocessor 46 and the main 
memory 48 through the main memory interface 54. As noted above, one main 
memory type is an SDRAM and another main memoiy type is a RDRAM, it being 
1 0 understood ftat other types may also be used. 

Referring now also to FIG. 3, the main memoiy interface 54 is shown in 
more detail to include a main memory API controller 64 and a microprocessor 
memoiy interface control/EDAC section 66. The data to and from the main memoiy 
48 passes through the EDAC portion 70 of section 66, such EDAC portion being 
1 5 described in more detail in connection with FIG. 5. The main memoiy API controller 
64 is responsible for translating upper-level read, write, and refresh requests into the 
appropriate low-level control signals for the type of main memoiy 48 being used. 
That Is. the data to and from the main memoiy 48 is through the main memory API 
controller 64 in response to control signals supplied by the microprocessor memoiy 
20 interface control/EDAC section 66. TTie control signals are generic, that is they are 
independent of the type of main memory 48 being used. The main memory API 
control 64 is hard-wired a priori to translate the generic control signals into the proper 
protocol for the particular type of main memoiy 48, i.e., SDRAM or RDRAM, etc. If 
for example, the original application for the CPU controller 44 is with an SDRAM, 
25 and at some future time the application will use an RDRAM, the only portion of the 
microprocessor interfece 52 which must be reconfigured is the main memoiy API 
confroller 64; the design of the microprocessor memoiy interfece control/EDAC 
section 66 may remain unchanged. 

Referring also to FIG. 4, the microprocessor memory interface 66 has 
30 three sections: the EDAC section 70. a memory interfece control section 72 and an 
address/data register and control section 74. The microprocessor memory interface 66 
manages the interfece between the microprocessor 46 and the main memoiy API 
controller 64. It performs the required address decoding, burst address counter. 
Opcode generation, refresh generation, and main memory API controller 
35 64/microprocessor 46 synchronization. TTie address/data register and control section 
74 contains the necessary input and output registers to properly align the 
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microprocessor 46 data stream with the main memory 48 data stream after it has 
passed through the EDAC section 70. 

The EDAC section 70 is described in more detail below in connection with 

FIG. 5. 

5 Various control and data lines and busses are shown in FIG. 4: 

CPU_.DatlOp<71.0> 
DBBnp 

CPU^Adrp<35.0> 
TSnp 

10 ABBnp 

TTlp 

TT3p 

TBSTnp 

TSIZp<2.0> 
15 AACKnp 

TAnp 

which are defined in the Motorola MFC 750 microprocessor Manual; 

Clock 

Reset and 
20 Pulse 

which are system inputs; 

the following EDAC signals: 

SHE - single bit error indication 

MBE - multiple bit error indication 
25 PErr - parity error indication 

Sjmdrome - XOR reduced syndrome bits 

Err^Cnt - error count (number of EDAC errors detected^Airing a data 

transfer) 

Config^Data - indicates where the EDAC is either an error detect or error 
30 correct mode and whether the EDAC is in even or odd parity; 

the following are defined by Rambus Application Guide 
(www.rambus.com): 
WD 
RD 

35 Wdone 
Rrdy 
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Busy 
Last 
Ai 
Ao 

5 Mo 
Op 
Start 

and the following which are conventional SDRAM interface signals: 
DQ<71.0> 
10 Adr<13.0> 
CSn 
RASn 
CASn 
WEn 

15 DQM 
CKE 

Referring again to FIG. 3. the data rebuffering section 56 is responsive to a 
control signal from the CPU decoder 50, for coupling data between a selected one of 
the data ports, i.e., port A, port B, or the embedded SRAM or the interrupt request 

20 controller 58, and the data port ofthe microprocessor 48. More particularly, the data 
rebuffering section 56 has a port A transceiver (XCVR), a port B XCVR 82, an 
XCVR core 83, and a CPU XCVR 84, arranged as indicated in FIG. 3. The XCVR 
core 83 is a selector which, in response to a control signal from the CPU decoder 50, 
couples data/address between port 86 ofthe CPU XCVR 84 and either: the port A 

25 XCVR 80; or, the port B XCVR 82; the embedded SRAM 60. or the interrupt request 
controller 58 selectively in accordance with a control signal fed to the XCVR core 83 
from the CPU decoder 50. (As noted from FIG. 2, here the port A XCVR is 
connected at port A to the cache memory 1 8 (FIG. 1) through the DMA 42 and the 
port B XCVR 82 is coupled at port B to the shared resources 40. 

30 The CPU XCVR is a data distribution unit having a plurality of ports each 

one ofthe ports being coupled to a corresponding one of: (i) the XCVR (selector) 83; 
(ii) the Synchronous DRAM 60; (iii) the interrupt request controller 58; (iv) the 
micropK)cessor 46 data port; and (v) the main memory interfece 54. 

More particularly, the XCVR core 83 and CPU XCVR 84 are shown in 

35 FIGS. 3A, 3B, and 3C. The data rebuffering section 56 mechanism that supports 
microprocessor write operations is shown in FIG. 3 A. The here 72 bit data from the 
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microprocessor 46 data transfer bus transfers to the microprocessor interface 52 at the 
CPU_DataIOp interface. The microprocessor interface 52 has two registers 87, 89, 
one for the upper data word and one for the lower data word, respectively. The 
CPU_DatWUClkEnp and DatWLCIkEnp are used to enable data registering into the 
5 upper and lower word lanes on flie rising edge of a clock, not shown, respectively. 
Parity is stored along with the corresponding word's data. CPU_DatSyncSelp, when 
clear, causes the input registers 87, 89 to be by-passed providing an asynchronous 
data path to Port A and Port B. CPU_ULSeIp determines whether the upper or lower 
register 87 or 89 word is passed to port A or port B. This is necessary as the 
10 microprocessor 46, here Power PC, data interface 52 is 72 bits while here the Port A 
and Port B interfaces are 36 bits wide. 

Port A and Port B are identical in operation. Thus 
PortA/PortB_DatWCIlcEnp clocks data PortA_DatIOp/PortB_DataIOp into the output 
port data registers 187, 189 respectively on the rising edge of the Clock. 
15 PortA/PortB_DatSyncSelp, when clear, provides an output register bypass mechanism 
for asynchronous output data. PortA/PortB^DatlOOEnp enable the output drivers 91, 
93 for the ports A and B. 

A separate data path (SDIO) is used for the main memory interface 54. 
The main memory interface 54 has a dedicated set of input registers 95, 97 in the CPU 
20 XCVR 84 which are enabled (EN) when DBBnp from the CPU decoder 50 is 
asserted. 

The data rebuffering section 56 mechanism that supports the 
microprocessor 46 read operation is shown in FIG. 3B. For read operations, data 
transfers to the microprocessor interface 52 at the PortA/PortB_DatIOp interfaces. 
25 PortA/PortB_DatRCIkEnp are used to enable data registering on the rising edge of the 
Clock, respectively. PortA/PortB_DatSyncSelp, when clear, causes the input registers 
99, 101 to be bypassed providing an asynchronous data path. Sueh an arrangement 
allows design flexibility (e.g., tradeoff between performance and latency). 

CPU^DatPortSelp determines the data source for the CPU output registers 
30 1 03, 1 05 . The Table below list the possible data sources: 



35 
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CrU_DatPortSelp 
Value 


Data Source 


000 


^"licuuy 5iorea in ine microprocessor output registers 


001 


Data currently stores in the Port A output registers 


010 


Data Currently stored in the Port B output registers ' 


on 


All Is with good parity 


100 


Internal configuration and status registere. The register data 
is presented on the lower word and the upper word is 
padded with all Os and good parity. 


101 


Data from Port A. 


no 


Data from Port B. 


111 


Data from the EDAC 70 



CPU.DamucikEnp and CPU-DatRLClkEnp clocks data into the upper 
and lower word lanes (e.g., registers 103. 105) on the rising edge of the Clock. TTie 
external CPU decoder 50 (FIG. 2) must control these signals appropriately to present 
5 the PortAyPortB data on the correct word line based on the least-significant address 
decodes. CPU.DatSyncSelp, when clear, causes the CPU output registers 103, 105 in 
the data path to be bypassed providing asynchronous output to the Power PC 
microprocessor 46. 

A separate data path SDIO is used for the main memory interface. The 
10 output from the main memory controller 64 is fed to a top-level output multiplexer 
107. Any time the microprocessor interface 52 decodes an address in its internal main 
memoty space, the data presented to the mictx)processor is from the main memoiy 
controller. Otherwise, the data presented to the microprocessor is from the 
microprocessor 46 output structure. 

CPU_DatIOOEnp controls the CPU output buffers and is valid only during 
non-main memoiy transactions. During main memory control, the microprocessor 
mterface 52 controls these output drivers 1 03 to present data to the microprocessor 46 
at the correct time. 



15 
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Referring now to FIG. 3C, the addressing rebuffering mechanism that 
supports the microprocessor address path is shown. Address rebuffering in the 
microprocessor interface 52 is unidirectional and is source at the CPU^Adrp port. 
CPU_AdrS3mcSelp determines on a global basis whether the address path is 
5 synchronous-pipelined or asynchronous (default). During asynchronous operation, 
the external CPU decoder 50 (FIG. 2) must ensure that the address has enough time to 
propagate through the microprocessor interface 52 to Port A/PortB before asserting 
Ext^AACKnp. 

During synchronous operations, TSnp clocks the current address into the 
10 CPU Address input register 111. When the external CPU decoder 50 (FIG. 2) asserts 
Ext^AACKnp, the address previously registered into the CPU Address input register 
1 1 1 is transferred to the Port A and Port B Address Output registers 113,115. 
PortA/PortB_AdrIOOEnp selectively enable their respective port address output 
drivers 117, 119. 

15 The internal main memory controller 64 has a dedicated set of address 

registers 111. When TSnp asserts, the address on CPU_Adrp is clocked into one of 
the main memory address registers 1 1 1 for use by the main memory controller. 

As noted briefly above, the main memory 48 has a plurality of data storage 
sections, one section having a first set of addresses and a second section having a 

20 second set of addresses. It should be understood that there may be more than one 
second section (i.e., the second section may be made up of a plurality of regions, or 
sections). The microprocessor interface 52 produces addresses for the main memory 
48. The main memory controller 64 has a decoder 65 responsive to the produced 
addressed to determine whether the produced address is within the first set or the 

25 second set of addresses. The main memory interface 54 is adapted for coupling to the 
main memory 48, The main memory 48 is adapted for coupling to the microprocessor 
46 and to the data rebuffering section 56. The main memory interface 54 provides 
control signals for enabling data transfer between the main memory 48 and the 
microprocessor 46 toough the data rebuffering section 56. The main memory 

30 interface 54 is responsive to the decoder 50 and enables the second section in the 
memory 48 when the decoder 50 determines the produced address is in the second set 
of addresses and the first section is enabled for addressing by the produced address 
when the main memory interface 54 determines the produced address is in the first set 
of addresses. 

35 More particularly, and referring to FIG. 3D, four external SDRAM chip 

selects CS0<:S3 provide access to the SDRAM 48. Access to the SDRAM via the 
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chip select is decoded by the external CPU decoder 50 (FIG. 2). The decoded address 
must fell outside the memory space allocated to the microprocessor interface 52 here 
addresses 000 OOOOh to 7FF FFFFh. A configuration register defmes an address mask 
which is applied to the Power PC microprocessor 46 address to qualify a segment 
5 size. i.e., the size of the SDRAM associated with each chip select Each chip select 
also has a segment address register, (i.e., DRAM CSx segment address) with which it 
is associated. This segment address register provides an OR-field which is added to 
the microprocessor address after the address segment size mask is applied. This 
allows the four chip selected SDRAM spaces to be located independently throughout 
10 the SDRAM space. 

Assuming, for example, a full memoiy configuration of 128 MB and that 
this configuration demonstrates four segments of 64K apiece located at the top 256 K 
of SDRAM memory space. Assume that the CPU decoder decodes a chip select 
memory access at address 0820 1234h. As will be described in connection with FIG. 
15 3D, the input address provided by the microprocessor 46, here 0820 1234h and stored 
in register 1 1 1 will be mapped to a new output address, here 07FC 1234h) shown in 
region 212 shown in FIG. 3D. 

More particularly, the microprocessor address segment mask of 07FF 
OOOOh is applied to this address yielding a resulting address of 0800 1234h. Next, the 
20 appropriate DRAM chip select segment address is OR'd in. Assuming chip select 
CSO was used, 07FC OOOOh is OR'd witii the interim result to produce OFFC 123h as 
the chip select memory address. The uppermost 5 bits are truncated from the address 
as they are beyond the 128 MB of addressable memory. The final memory address 
becomes 07FC 1234h for the chip select of die SDRAM access. 
25 More particularly, and referring to FIG. 3D, it is first noted that first 

addresses in the main memoiy 48 (i.e., the section 2 16 having the first 128 MBytes 
minus 256k of memoiy) is dedicated for addressing only by the microprocessor 
interface 52. The upper 256 Kbytes have been segmented into four segments 214a- 
214dof 64keach. Each one of these four segments 21 4a-2 1 4d is selected by a 
30 corresponding one of four chip selects CS0.CS3, as indicated. Here, the address 
(here, for example, 0820 1234h) is shown provided by the microprocessor 48 is stored 
in register 1 1 1 (FIG. 3C). The segment size is stored in one of the registers, here 
register 200) m set of registers 53 (FIG. 2) in the main memory interface 54, here, in 
this example, 07FF OOOh). For each bit in register 1 11 is gated with a corresponding 
35 bit in register 200 in gates 202 with the gated output (l.e., interim result) being shown 
in region 206. here 0800 1234h. The desired chip select segment enabling the various 
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storage sections for the main memory 48 is stored in register 208 in set of registers 53. 
Here, in this example the register 208 stores 07FC OOOOh, as indicated. Each one of 
these bits is OR gated with a corresponding one of the bits produced at the output of 
gates 202 to provide the result shown in region 210, here the chip select SDRAM 
5 mapped addresses OFFC 1234h, as indicated. After truncating bits 3 1 through 37, as 
indicated by the bracket 212, such truncated result is fed as the address to the main 
memory 48, as indicated. It is noted that addresses 07FC 0000 through 07FF FFFF 
are in the above described second section of the main memory 48 here having four 
region 21 4a-214d, each with 64K addresses. Here, regions 21 4a-214d are selected by 
10 chip selects CS0-CS3, respectively. Thus, it is noted that the input address provided 
by the microprocessor 46 and stored in register 1 1 1 has been mapped to a new output 
address shown in region 212. ERROR DETECTOR 

Referring now to FIG. 5, the error detection and correction section 
(EDAC) 70 is shown in more detail. The EDAC 70 is coupled between the main 
15 memory API {Application Programming Interface) controller 64 and the CPU XCVR 
84 through a data bi-directional I/O bus (MDIO) and the system data bi-directional 
I/O bus (SDIO), as shown in FIG. 3. Considering fu-st data flow from the SDIO to the 
MDIO, a source of data, here the data read from the CPU XCVR 84 {FIG. 3), is 
applied to the SDIO. The data has a plurality of bytes, here eight bytes (i.e., 64 bits), 
20 each one of the bytes having a parity bit. A parity checker 90 is responsive to the 
parity bits on SDIO and the eight bytes of data on SDIO for detecting a parity error in 
the data eight bytes of data produced by the data source on SDIO. Any parity error is 
reported to the CPU decoder 50 (FIG. 2). 

A pair of check bit generators are provided. Each one of the parity bit 
25 generators 92, 94 is fed the plurality of bytes, here eight bytes, of the data on SDIO. 
Each one of the parity bit generators 92. 94 is a redundancy code generator, here a 
modified Hammmg code check bit generator, which generates a plurality of check bits 
from the plurality of bytes fed thereto. A logic, here an XOR gate 96, is fed by the 
check bits produced by the pair of check bit generators 92, 94 for determining 
30 whether the pair of check bit generators 92, 94 produce different check bits for the 
same bytes fed thereto. A logic, here an XOR gate arrangement 98 is fed by the 
check bits produced by one of the pair of check bit generators, here generator 92, for 
producing a single, combined parity bit fix)m the generated check bits. One such 
XOR gate arrangement 92 is shown in FIG. 5A to include a plurality of, here six 
35 XOR gates 93 arranged as shown being fed by eight bits BpBg to produce a combined 
parity bit on line 95. 
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The eight parity bits on SDIO are fed to a logic 100, here an XOR gate 
arrangement similar to the arrangement 98 shown in FIG. 5A, for producing a 
combined parity bit CHK_PAR from the plurality of parity bits. A logic 102, here an 
XOR gate, is provided to determine whether the combined parity bit produced by tiie 
5 logic 98 and the combined parity bit produced by the logic 100 have the same logic 
state. Absent any error or fault, the parity bit CHK_PAR and the combined parity bit 
produced by the XOR arrangement 98 will be the same. The output of the XOR gate 
96 and XOR gate 102 are fed to an OR gate 104 which produces a check bit error 
signal for an OR gate 1 32 if a fault has been detected by either a mismatch in the 
i 0 parity bits fed to the XOR gate 96 or the XOR gate 1 02. 

Considering now the flow of data from the MDIO to the SDIO, a data 
source, here the data read from the main memory 48 and placed on the MDIO bus. has 
a plurality of, here eight bytes and a plurality of, here eight check bits associated with 
such bytes. The eight check bits are stored widi the data and had been generated from 
1 5 a redundancy generating code, here a modified Hamming code. A pair of check bit 
generators 106, 108 are provided. Each one of the check bit generators 106, 108 is 
responsive to the plurality of, here eight bytes of the data on the MDIO bus for 
generating here eight check bits. The check bit generators 106, 108 are redundancy 
code generators, here modified Hamming code generators. A logic 1 10, here an 
10 XORing arrangement such as that described in connection with FIG. 5A is provided 
for producing a combined parity bit from the generated check bits. The combined 
parity bit is fed to an input of XOR gate 112. 

A pair of error detector/correctors 1 14, 1 16 is provided. Each one of the 
detectors/correctors 1 14, 1 16 is responsive to; the eight bytes of data on the SDIO; the 
5 generated check bits of a corresponding one of the pair of check bit genoators 106, 
108; and, the eight check bits associated with the bytes of data on the SDIO. Each 
one of the pair of error detector/correctors 1 14, 1 16 includes a pair of syndrome 
generator 118, 120, respectively, and a pairof data_correctors 122, 124, respectively. 
Each one of the pair of error detector/correctors 1 14, 1 16 is adapted to detect an error 
0 in the bytes fed thereto and adapted to correct such data in event of a detected error in 
accordance with conventional modified Hamming code error correction and detection 
techniques (i.e., a single bit error is detectable and con^ctable and a multiple bit error 
is detectable). 

A parity bit generator 126 is provided for producing a plurality of, here 
S eight, parity bits from data produced by one die pair of error detector/correctors 1 14, 
1 16, here die data_corrector 122 of generator 1 14. A logic 128, here an XOR 
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arrangement similar to that described above in connection with FIG. 5A, is provided 
for producing a combined parity bit, GEN^^PAR, repreisentative of the eight parity bits 
produced by the parity bit generator 126. The eight parity bits produced by the parity 
bit generator 126 are fed to the SDIO. 
5 A logic, here the XOR gate 11 2, is provided to determine whether the 

combined parity bit produced by the logic 1 10 and the combined parity check bit from 
the logic 128 have the same logic state. A logic 130. here an XOR gate is provided 
for determining whether the data produced by the data__correctors 122, 124 of the pair 
or error detector/correctors 1 14, 1 16 is the same. If they are different an syndrome 
1 0 error is produced. This syndrome eiror together with the output of the XOR 11 2 and 
the CB error are fed to an OR gate 132 to produce a chip error signal for the interrupt 
request controller 58 (FIG. 3). 

INTERRUPT REQUEST CONTROLLER 58 
Referring now to FIG. 6, the interrupt request controller 58 is shown in 
1 5 more detail. The interrupt request controller 58 manages interrupt inputs and 

programmable interrupt inputs or general purpose outputs. Here 28 dedicated inputs 
feed the interrupt request controller 58 directly and four fatal interrupts (Fatal Jndop 
<3..0>) are OR-reduced to a single entry by a fatal mask 300 in the interrupt request 
controller 58. It is noted that these four fatal requests may be programmed as general 
20 purpose outputs. 

The interrupt request controller 58 includes an interrupt inverter section 
304 (FIG. 7) fed by the ORrd output from the fatal mask 300 and the here 3 1 other 
interrupt request (IRQs); a watchdog IRQ produced by watchdog timer 301 which is 
fed refresh pulses, select signals and data from the XCORE selector 83, a Match IRQ 
25 produced by Match 303 which is fed addresses, data and select signals from the 

XCORE selector 83, a microprocessor interface IRQ produced by the microprocessor 
interface 52 (FIG2), and 28 Intp <27..0> IRQs produced by inputs^temal puis of 
the microprocessor interface 52. Each one of the 32 IRQs are fed to an interrupt 
invert register 306 in the interrupt invert section 304, and exemplary one thereof being 
30 shown in FIG. 7. The intemipt request IRQ is fed to one input of an XOR gate 308, 
the other input being fed by the output of a register 310. If the particular IRQ sense 
(i.e., either positive-true or negative-true) is to be inverted, a logic 1 is stored in the 
register 3 10, On tfie other hand, if the IRQ 306, is not to be inverted, a logic 0 is 
stored in the register 3 10. 
35 In any event, the 32 outputs from the intemipt invert 204 are fed to an 

intemipt type register section 3 12. More particularly, each bit is fed to an interrupt 



-17- 



type register 314. an exemplaiy one thereof being shown in FIG. 8. The intemipt type 
register 3 14 detemines whether the interrupt IRQ should be an edge (leading or 
trailing edge) or remain as a level. More particularly, the register 314 includes a 
muhiplexer 316. TTie multiplexer 3 16 has one port, port A. fed by the intemipt 
5 request IRQ and the other input, port B, fed by an edge logic 318. The edge logic 318 
includes an OR gate 320. One input to the OR gate is fed by the interrupt request IRQ 
through an AND gate 319 and register 321. as indicated, and the other input to the OR 
gate 320 is fed by a clear signal through AND gate 322, as indicated. The output of 
the OR gate is fed to a register 330. n,e output of register 330 is fed to the B input of 
10 multiplexer316. A register 326 is provided to produce the port select signal for the 
multiplexer 316. If a logic! is stored in the register 326. the A port is coupled to the 
outputofthemultiplexer316therebyselectedaIeveIasin intemiptrequesttype. On 
the other hand, if a logic 1 is stored in the register 326 the output of the edge logic 318 
IS coupled to the output of the multiplexer 316. 
15 More particularly, in response to a clock pulse, register 32 1 stores the level 

of the mtemipt fed thereto. The stored level is fed to the inverted input of AND gate 
319. Thus. AND gate 319 compares the level of the present intemipt with the level of 
the previous interrupt (i.e.. the level of the interrupt on the previous clock). If they 
differ, a logic 1 is asserted and becomes stored in register 330. The stored logic 1 in 
20 register 330 is then fed back to the non-inverting input of AND gate 322. TTie output 
of AND gate 322, in the absence of a clear signal from the microprocessor interface 
52 (FIG. 2) passes through OR gate 320 where it remains until the presence of a clear 
signal. Thus the clear opens the feedback path. Thus, in response to an edge (i e 
leading or trailmg edge) of the intemipt signal, such edge is converted into a level' 
25 which appears at die output of register 330 (i.e.. at the B input of selector 3 16. 

The intemipt requests produced by the interrupt type register section 312 
.s fed to a current intemipt register 321 . The contents of the current intemipt register 
may be observed for testing or. in operation, for polling, for example. TTiese contents 
are also fed to a source mask 323 wherein any one of the 32 bits may be masked as 
30 desired. 

Additional registers assign each intemipt source to a particular level 
interrupt A mask register allows individual interrupts to be masked. In addition, the 
intemipt request controller contains logic for emulating the Motorola 68k family ' 
mterrupt logic. TTiis logic includes registers which contain cummt IPL level and 
35 status and provide the necessary hardware to simply implement an emulated 68k 
interrupt scheme. 



-18- 



More particularly, the Int4 through IntO mask registers in section 325 
select which interrupt bits from the source mask register 323 participate on a given 
level. Each Intx mask is OR-reduced in OR gate section 327 to arrive at the primary 
IRQnp<4..0 ou^uts. These outputs may be used whwe desired to change the flow 
5 in execution of a program, for example. Similarly, the Int68k7 through Int68kl mask 
registers in section 329 select which interrupt bits participate on Motorola 68k.style 
level. Each level is OR-reduced in section 33 1 and then fed to the IPL level/mask 
register 333. This register can individually mask any interrupt level. An IRQ68knp 
interrupt is then generated based on the level information stored in the IPL level/mask 
10 register 333 and the current IPL register 335. 

The microprocessor 46, here Power PC, microcode may use the IPL^mask 
and current IPL registers 333. 335 to emulate the built-in capabilities of the Motorola 
68k family of microprocessors. The current register contains the highest-level 
interrupt currently pending. By reading this register 335 and then reprogramming the 
1 5 IPL level/mask register 333, the microprocessor interface 52 can emulate the IPL 
level masking capabilities found in the 68k family of microprocessors. A simple 
driver routine need only be written to manipulate these registers upon receiving an 
interrupt so the ISR can branch to the traditional 68k- style interrupt vectors. 

Thus, section 333 is a progranunable mask section for coupling unmasked 
20 ones of the interrupt signals to a plurality of outputs selectively in accordance witii a 
predetermined priority criteria. 

FAULT DETECTOR 
Referring now to FIG. 9, a circuit 400 is shown for detecting a hard fault 
(i.e., a ground &ult or a connection to a fixed, unchanging voltage) on a bi-directional 

25 data line 402. The circuit 400 includes an input/output terminal 304 connected to one 
end of the bi-directional line 402; a data receiver 406 having an input coupled to.a 
second end of the bi-directional line 402 for receiving data on the temiinal 404; an 
date driver 408 having an output coupled to second end of the bi-directional line 402 
for producing data on the terminal 404; an XOR gate 410 having a pair of inputs, one 

30 being coupled to an output of the data driver 408 and the other being coupled to an 
input of the data receiver 408, for determining whether data produced by the data 
driver is received by the data receiver. 

For example, assume a ground Is shorted to tiie line 402. When the data 
driver 408 is enabled by an enable signal EN and is to produce, in response to the 

35 logic signal fed to the input of the data driver 408, a high logic voltage on the line bus, 
the ground will produce a low logic signal at the output of the XOR gate 410. Thus, 
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the XOR gate output will indicate that the input to the data driver 408 is different 
from the output produced by the data receiver 406, thereby producing a logic 1 and 
therefore indicating a fault. 

It should be understood that if die hard fault on the line 402 is a high 
5 voltage which is fixed and remains constant over a number of normal data cycles, 
when the data driver 408 is enabled by an enable signal EN and is to produce, in 
response to the logic signal fed to the input of the data driver 408, a low logic voltage 
on the line bus, the high voltage fault will produce a high logic signal at the output of 
the XOR gate 410. Thus, the XOR gate output will indicate that the input to the data 
10 driver 408 is different from the output produced by the data receiver 406, thereby 
producing a logic 1 and therefore indicating a fault 

Other embodiments are within the spirit and scope of the appended claims. 

What is claimed is: 
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1 . A data storage system wherein a host computer is in communication 
with a bank of disk drives through an interface, such interface comprising: 

a memory; 

a plurality of directors for controlling data transfer between the 
S host computer and the bank of disk drives as such data passes through the memory; 

a plurality of busses in communication with the directors and the 

memory; and 

wherein each one of the directors includes a central processing 
unit, such central processing unit comprising: 
10 (A) a microprocessor; 

(B) a main memory; 

(C) a microprocessor interface, comprising: 

a semiconductor integrated circuit having formed therein: 

(i) a data rebuffering section disposed in the chip 

1 5 and adapted to couple data from a one of a plurality of data ports to a data port of the 
microprocessor selectively in accordance with a control signal; and 

(ii) a main memory interface adapted for coupling to 
a main memory for the microprocessor, such main memory interface being adapted 
for coupling to the microprocessor and being coupled to the data rebuffering section 

20 for providing control signals to the main memory section for enabling data transfer 
between the main memory and the microprocessor through the data rebuffering 
section; 

(D) a controller coupled to the data rebuffering section for 
producing the control signal. 

25 

2. The system recited in claim 1, wherein the central processing unit main 
memory is a selected one of a plurality of memory types each type ji^ving a different 
data transfer protocol and wherein the main memory interface is configured in 
accordance with the selected one of the plurality of memory types to provide a proper 

30 memory protocol to data being transferred between the microprocessor and the main 
memory through the main memory interface. 

3. The central processing unit recited in claim 2 wherein one main 
memory type is an SDRAM. 

35 
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4. The central processing unit recited in claim 2 wlierein one main 
memory type is a RDRAM. 

5. The system recited in claim 1 wherein the central processing unit data 
5 rebuffering section includes: 

a selector responsive to the control signal for coupled data between 
a selected one of the data ports and the microprocessor. 

6. The central processing unit recited in claim 5 whwein the data 
rebuffering section includes a data distribution unit having a plurality of ports each 
one of the ports being coupled to a corresponding one of: 

(i) the selector; 

(ii) a random access memory; 

(iii) an interrupt request controller; 

> (iv) the microprocessor data port; and 

(v) the main memory inter&ce. 

7. The system reacted in claim 6 wherein the central processing unit main 
memory is a selected one of a plurality of memoiy types each type having a different 
data transfer protocol and wherein the main memory interface is configured in 
accordance with the selected one of the plurality of memory types to provide a proper 
memory protocol to data being transferred between the microprocessor and the main 
memory through the main memory interface. 



SDRAM. 



RDRAM. 



8. The system recited in claim 7 wherein one main memory type is an 

9. The system recited in claim 7 wherein one main memory type i 



■■ IS a 



comprises: 



10. The system recited in claim 7 wherein the main memory interface 



a microprocessor/main memory interface control section adapted to 
provide control sipals between such section and the microprocessor and between 
such section and the controller; and 
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a main memory controller, such controller being configured in accordance 
with the selected one of the plurality of memory types to provide a proper memory 
protocol to data being transferred between the microprocessor and the main memory 
through the main memory interface. 

11. The system recited in claim 10 wherein one main memory type is an 

SDRAM. 

12. The system recited in claim 10 wherein one main memory type is a 

RDRAM. 

13. The system recited in claim 10 wherein the main memory interface 

comprises: 

a microprocessor/main memory interface control section adapted to 
provide control signals between such section and the microprocessor and between 
such section and the controller; and 

a main memory controller, such controller being configured in accordance 
with the selected one of the plurality of memory types to provide a proper memory 
protocol to data being transferred between the microprocessor and the main memory 
through the main memory interface. 

14. The system recited in claim 10 wherein one main memory type is an 

SDRAM. 

15. The system recited in claim 10 wherein one main memory type is a 

RDRAM. 

16. The system recited in claim 13 wherein the main memory interface 
includes an error correction and detection unit coupled between the distributor and the 
main memory controller, 

17. The system recited in claim 16 wherein the microprocessor is a Power 
PC microprocessor 

18. A data storage system wherein a host computer is in communication 
with a bank of disk drives through an interface, such interface comprising: 
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a memory; 

a plurality of directors for controlling data transfer between the 
host computer and the bank of disk drives as such data passes through the memoiy; 

a plurality of busses in communication with the directore and the 

5 memoiy; and 

wherein each one of the directors includes a central processing 
unit, such central processing unit comprising: 

(A) a microprocessor; 

(B) a main memory having a plurality of data storage sections, one 
10 section having a first set of addresses and a second section having addresses a second 

set of addresses; 

(Q a microprocessor interface, comprising: 

(0 a memory controller for producing addresses for the 
main memory, such memoiy controller having a decoder responsive to the produced 
1 5 addressed to determine whether the produced address is within the firet set or the 
second set of addresses; and 

(ii) a main memory interface adapted for coupling to a main 
memory for the microprocessor, such main memoiy inter&ce being adapted for 
coupling to the microprocessor and being coupled to the data rebuffering section for 
20 providing control signals to the main memoiy sectfon for enabling data transfer 
between the main memory and the microprocessor through the data rebuffering 
section. (D) a controller, responsive to the decoder, for enabling the second 

section in the memoiy when the decoder determines the produced address Is In the 
second set of addresses; and 

(E) wherein the first section is enabled for addressing by the 
produced address when the decoder determines the produced address is in the fust set 
of addresses. 
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19. The system recited in claim 18 includmg a mask to tiansfonn the 
address to an address in Ae second section of the memory. 

20. A data storage system substantially as 
hereinbefore described and shown with reference to Figures 
1 to 9 of the accompanying drawings. 
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